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* A SUMMARY OF THE EVALUATION 
FOR THE r 
1980-1981 LEARNING TO READ THROUGH* THE ARTS PROGRAM 



• Learning, To Read Through the Arts (L.T.R.T.A, ), a Tit^e I Children's 
' Program, offers intensive individualized readinq instruction throuqh the^in- 
\ teqra'tion of a total arts program with a totaT readinq propram. In 1980-1981, 
the program served 1,160 children" from all five boroughs who were readinq at 
least one year below grade level, including 94^specia1 education students. 
Most of the students were in qrades four to six, although grades two and three 
were included at the Staten Island site. 

.Students participated in two reading^orient&d arts workshops which 
s used the areas of theater arts, fine arts, and/or music to emphasize listen- 
ing, speaking, writing, and reading skills. They also attended a reading* work- 
shop which employed a diagnostics rescript ive approach to readinq through* indi- 
vidual and small group instruction. The workshops were closely coordinated.' ' 

* * •* 

In ^ition,'the program's association with various museums, (the 
Queens Museum, the Bronx Museum of the Artsy 'the Brooklyn Museum, and the 
Staten Island Children's Museum) the Ballpt Kispanico of 'New York, and^the New 
York Aquariunr, provided students with field trips to view exhibitions and per- 
formances culminating in the Learning to Read Through the Arts Exhibition, Per- 
, forming Arts, and Film Festival. <AVI children participated in this event* 

parental involvement was also an important part of the L.T.R^.A. pro- 
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gram. Parents were encpdraged.Jio participate in hands-on activities^ and in 
workshops geared to developing their understanding of how' children .learn and 
hpw to^he^p them at home- - \ 



hp! 
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The evaluation of L.T.*R.'T;A. in T980-1981 .i ncluded four components: 



' 1) assessment of reading .achievement of 1,066 regular students; 2) '.assessment 
of reading achievement of 94 special education s^tudjants; 3) assessment of com- 
munications efforts between L.T.R.T.A.* program staff and -students 1 sending* 
. school teachers; and 4) analysis of the L.T.R.T.A. staffs 1 reactions to specif- 
ic National Diffusion Network -Activities*. Each ,of these is summarized below. 

' * The California Achievement Test was used to measure changes in reading* 

* levels of the 1,066 regular students. The evaluation objective was a mean , 
tfain -score of five N.C.E.'s, the criterion, for success in Title I programs. 
The L.T.R.T.A. students attained an average gain of 13 If.C.E.'s; this indicates 
that L.T.R.T.A. was Very effective Vtr improving students 1 reading skills.. 

* ^The special education component toas similar in procedures and, consent 
- , for the 94.stiidents involved.^ The differences were a smaller class size, the 
participation-of entire classes ^nd their classroom teachers, and the use -of a 
different test to measure achievement. The Wisconsirf Design Sk^ll Development 
Test; 'a criterion-referenced test, was used to assess mastery in four skill 
areas: comprehension, phonetiVanalysis, structural analysis, and vocabulary. 
' The evaluation results show that students far. surpassed expeGted objectives 
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(60 percent were expected to.pass four objectives) with 88 percent'of the 
Students passing four .objectives ^and 82 percent of the students pa$,sinq five 
objectives, which they had failed to master bn the pretest. 1 . 

* Ofesehvations in a sample' of x Il classrooms, indicated the following 
about the efforts of L.T.R.T.A. staff to increase communications between the 
program and sending schools 1 v classroom teachers. 1) Teachers of reqt»lar §tu- 
dents were hesitant, to carry-over L.T.R.T.A.^proqram methodoloqy into tHeir 
'dass/ooms because not all the students participated in the proqram. 2) Teach- 
eK^jff special education students were more Tikely to carry-over L.T.R.T.A.* 

The L.T>R.T.A. program has been nationally val i dated-si nqe 1975 and 
has received funding from the National, Diffusion Network (N.D.N*.) of the UniteVi 
States Department of Education as a successful program which can be transfer- 
red to other schools and districts around the country. ~ A Questionnaire dis-« 
tributed to all L.T.R^T.A. teachers reveajs thafthe dissemination materials 
developed with N.D.N, fundjng were helpful jn their trainfnq. A la'rqe percent- 
age of respondents, reported numerous outside visitors to their classrooms,' and 
many teachers felt- that teaching at a developer/demoristator site was profes- 
sionally rewarding. * * * 

'The major recommendations resulting -from the L.T.R.T.A. proqram eva- 
luation^^ the following. 

I 

•The program should be continued and possibly expanded to* ' : 
* accommodate some- of the eligible students now on a waiting, 1 ist. . 

• Program staff may. wish to consider ways of expanding^ the " * 
program 'further to servfe bilingual or nonpublic school 
students. ... 

*■ « * ^ 

•Where possible, it is recommended that. entire Glasses and ' 
c their teachers participate i*n the program to ensure maxi- 

mum carry-over of program goals. n 

• Strategies should be explored for minimizing time. and effort 
spent establishing and transferring sites at the beqinninq of 
the year. * ' * % , 
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I. • EVALUATION -ABSTRACT 



•PROGRAM: Title I Children's Proqram: Learninq to Read Throuqh the Arts 

— — • •' . ' * f* 

'PROJECT ' IDENTIFICATION NUMBER; • 5001-48-1164.0' 
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FUNDING PERIOD-: 

■* — : — 

FUNDING SOURCE : 
BUDGET* 



September, 1^80-June, 1981 . 
U.S, Department of Education 
$819; 523*. • • 



NUMBER-OF STUDENTS IN, PROGRAM; (FULL *YEAR> 



STUDENT CHARACTERISTICS: 



.NUMBER OF' SITES' : , 
SITE CHARACTERISTICS: 



MAJOR PROGRAM COMPONENTS: 



EVALUATION .OBJECTIVE : 



EVALUATION INSTRUMENTS: 



TYPFTVf INSTRUMENT: 



TEST DATES: 



•e - 



■; # pretested' 
• # .posttested 
# prre- arjd posttested ' 



1160 
840 



* r Students in grades two to'^six reading' at* TeVst 
one year, below grade level. 

* \ * • ■ 

five. * * * * , 

- N One site each in Bronx," Queens', Manhattanr 
Staten Island, and Brpoklyn. * Students were 
bused to borough sites two aftefnoons a 
. week except in Staten Island, where children 
, attended the proqram in their own school. 
At each sitey .there were two concurrent week- 
cycles, two days per* week. Students attended • 
the proqram eight hours per week.'' 

During each session*, students participated in 
' ^twa reading-oriented arts workshops where they, 
'.received 'instruction iri reading and art. Ttfey 
also received three' hours of individualized* 
directed- reading instruction each week 'in a 
. reading workshop. Monthly field-trips and a v 
special* end-of-year. exhibition aiid-performance 



4 were featured. 



fit 



A mean gwn of five N".C;E.'s from pretest to 
posttest scores. * *~ . 

--.-,-•« . - v 

California Achievement Test in reading, form C, 
levels 11-16. ' - > * 

N^rrTH referenced test. 

October, 1980,**and foay, *1981. 



4 - <? j * 

'*{rifcjudes budget for speej^l education .comfhDrrent. 
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DATA ANALYSIS PROCEDURES: 



Pretest/posttest comparisons were made' in 
accordance. with Model A for Title. I programs.' 
The treatment effect was determined by compar- 
ing mean* pretest N.C.E.**s with -posttest 
N.C.E. K s.. ■ 



SUMMARY OF RESULTS: 


Overall Treatment Effect = 


13.0 


N.C.E. 


"s 




1 Gra'de 2 Treatment Effect = 


14l6 


N,C.E. 


's • ; 


< ■ «P 


Grade' 3 Treatment Effect = 


15.7 


N.C.E. 


's . / 


* * > 


~ . • ■ .Grade 4 Treatment Effect = 
Grade 5 Treatment Effect = 


15.0 
11.7 


N.C.E. 
• N.C'JE.. 




OBJECTIVE MET: 

♦ 

i \ 

* f 


Grade. 6 [Treatment Effect - = 

The, program surpassed the 
program success. 


10.0 N.C.E. 
criterion for 

V * 

1 
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*s 


» - V 


• *' ' , • V 

x * • * . ' 
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II. TITLE I CHILDREN" S PROGRAM: LEARNING TO READ .THROUGH THE ARTS 

* ^ 

* 9 ♦ 

PROGRAM DESCRIPTIO N ' x 

7~ 

The Title I* Children's Program: Learhinq to Read Through the Arts 
(L.T.R.T.A.) is an intensive, individualized reading program that focuses* 
on the* improvement of reading skills through [the integration of a total arts, 
program With a total .reading program. Mn the school ye^r 1980-1981, the " 
'program was offered fof two conciM^ren^ 29-week; cycles 'from October, 1980, 
to June, 1981. Two afternoons a week, Title I eligible children in the Bronx 
Queens, Manhattan and Brooklyn were bused to^Vprogram site in their borouqh. 
Each of these boroughs served 24t> students. In Staten Island,* where 1:he pro- 
gram was^held in their schools, two afternoons a week, 220 children partici- 
pated. A total qf 1,160 children participated in tJie 'program, including 94 
special education sjtudents. Evaluation results for special education stu- 
dents appear in. Sections III and IV ol^this report. 

Except in Staten Island/ the program was offered to fourth, * fifth 
and sixth graders who were between ¥ and 12, years old and .who were reading at 
least one year below grade level. In Staten Island, children in grades two 
to six w,ho were reading a year tjelow'qrade level were eligible *for the pro- 
gram. .The program V/as scheduled for 12:00 p.m. to 4:00 p.m. at all sites 
excep\staterf Island, where tt Was scheduled for lp: 00 a.m. ta 3:00 p.m. 

At^each progranr site,)studer}ts participated in two readinq-oriented 
arts workshops where listening, s>peakinq, wcitinq, and rqadinq skills were 

• . Xi ' ■ s 

emphasized. These workshops offered dance, theater, music, paintinq, ' sculp- . 
ture, graphics,^printmakinq, mixed media, ceramics, and'photograpjjy. As part 
of each^ workshop language was integrated with art by students recording the% 



day's language experiences iry their individual writing journals, while the' 
workshop leader recorded this information in a master journal, these exper- 
iences included the learning of .specialized vocabulary, norm-referenced* voca- 
bulary, reading skills', creative writing, and reading for informatiort, appre- 
ciation, and/or pleasure. 

I • ' * . * *-* ' ' ' 

In addition/ students participated -in a reading workshop which u.se^l 

a diagnostic-prescriptive approach to reading and emphasized individual and 
small group instruction. Each student ■ received at least three hours of read- 
ing instruction per week. The^reading workshops focused on comprehension, 
v word attack skills, study skills, and reading for appreciation and/or please 
ure. , The* reading-oriented arts workshops and the reading workshops were clo- 
sely^ coordinated. , 

Field trips were an integral part of the' proqram. The program is as- 
sociated with the-Bronx Museum of the Arts, the Brooklyn Museum, the, Queens* 
Museum, the Staten Island Ch/ildreVs Museum, Ballet Hispanico of New York, 
and the New York Aquarium. 0^ day each month was set aside for field trips 
to ntoseums* galleries, art and educational resource centers, and libraries to 
view exhibitions and performances* For the second year, -children, performed 
. Y the Macy's City Kids Event,' at Macy's flerald Square in New ?ork City. 

The Learning to,Read Through the Arts- Exhibition, Performing Artsy 
a/id Fi lrii festival represented the culmination of %he year's activities. The 

main exhibition was held at the Schoohof Visual Arts Museum in New York; con- 

1 > 
commitantly, exhibitions and performances were held at the five Learning to 

I 

Read Through t^e Afts Centers as part of this major final event. All children 

. d ' • " - , 

participated in tljis event. * 1 

\ I * . . 

Parent „work stops wece held -at each site for 90 minutes a weelcfor . 



ten weeks. The workshops, which were conducted by" the assistant coordinators 
and a social worker, focused .on how children learn an^on family, life. educa- 
tion. ' Parents also participated in hands-on activities qeared to teafchiYiq* 

. * -a - - - 



-them'about the program. The. workshops also offered "suqq'estions on- how '.parents 
cquld'help their phildren with reading at home. Parents were.invited taob-> 
serve their children's, workshops. • . m> ^ 

EVAIUATION RESULTS . • , - ' - 

Th.e program objective^was for students in the prograprto achieve a 
mean, gain of* five Normal Curve Equivalents (N.C.E.'s) on # the, California 
Achievement Test in reading.* Pretest, and posttest data w.ere analyzed using 

Model A of the U.S. Department of Education's recommended approaches for. 

• . * • V 

. Title I evaluations.** , 

* According to this oorm- referenced model, it is expected that without 
treatment, a student's percentile on. a pretest will remain the same on a post- 
test, i.e., under no-treatinent cqnditions^ a student .is expected to remain in 
the Same position, relative to other students, on both pretest and posttest. 
If the 'percentile status on the posttest is qreater th^n on the pretest, gain 
can be- attributed to the effectiveness of the program*- * The User's Guid6 stip- 
ulates that gains are to be reported in N.C.'E.^s, which are based on an equal 
interval scale* N.C.E.'s match the precentile ranks of th^e^distr^biitiQji of 



~" *The L.T'.R.T.A. evaluation testing program was* administered at the stu- 
dent/ s funptional level, at pretest (October, 1980) and posttest (May, 1981). 
As pa^rt of the Citywide Testing Program, , students were a-dnrinistered an al- ' • 
ternatjive fonn of the CAT in ^rfril, J 981. - The Citywide Test-ing Proqram is ' 
administered at the student' 1 S^nstructional (grade) level. I { 

**See-G.K. Tallmadge, et a\ 9 User's Guide: EsA Title' I Evaluation and 
Reporting System. Mountain View, California: RMC* Research Cor[D. (Prepared 
for U.S. Department of Education), Revised February, 1981 



of a nationally representative sample' 'of students. 

The California Achievement Test, form C, levels 11-16/ in reading', 

3 

was used to assess student readinq improvement. The California Achievement 
Test is a standardized, norm-referenced tes,t. / : m 

The students in L.T.R.f.A. not only surpassed the criterion for sue 
cess set* for Title I programs, they»gained 13 N.C:H.'.s; The'meciri pretext 
score for students in the program was 27 N.C.E.'s, while 0 the mean posttest 
'score was 40 N.CJ^.'s. (see Tables 1 and 2.) These scores fr^icate consider 
able improveniepx in participants 1 reading skills, both overall and for each 
grade level./ t / r 



■ TABLE 1 

• . 1 > ■- 

* y" ~* 

> California Achievement Test, Pretest/Posttest Means in N.C.E.'s* 

For Participants Taking both Tests 



(Grade 



Number of Pretest Posttest Mean 
Students j N.C.E": N.C.E. - Gain 



Second 
Third 
Fourth 
Fi f th 
Sixth 

Grades two to six 



64 
39- 
294 
306* 
"137 

TO 



36.3 


50.9 


14.6 


30.4 


'46.1 


15.7 


24.1 


39.1 


15.0 


27.. 4 ' 


'. -39.2 


11.8 


26.7 


36.7 


10.0 


27:0. 


* 40,0 \ 


.13.0 



y f 




TABLE 2 

Frequency Distribution of N.C.E. Scores on Pre- and Posttests by, Quartile 
i 

For All Participants Taking Both' Pretest and Posttest\ 



Pretest Distribution by Quartile 



Posttest Distribution by Quartile ' 



Grade 




1-25 


. 26- 


50 


51 


-75 


76- 


■99 


1- 


-25 


r 

' 26- 


50 


SI 


-75 


76 


-99 




N 


To 


N 


To 


n 


h 


M 
11 


% j 


M 


of 


IN • 


of 
h 


M 


Of 

h 


IN 


h 


Second 


12 


19%, 


44 


69% 


8 


12% 










37 


58% 


24 


37% 


3 


5% 

<J to r 


(n=64) 








*• 


























Third 


- 14 


36 


21 


54 


* 4 


10 


f 




' 2 


5% 


• 23* 


59 


12 


31 


2 


•5 


(n=39) 
























* 










Fourth 


164 


56 


124 


"42 


5 


1.7 


1 


■ .3 


44 




' 199 


68 


48 


16 


3 


i 


x (n<94> 














> 




















Fifth 


116 


38 


184 


60 


6 


2 










* 236 


78 


34 


U 


4 


i 


(n=306) 






























♦ 


"^Sixth 




































63 


46 


73 


53 


1 


1 






31 


23 


94 


68 


12 


9 






(n=137). 


































ATI 






€■ 




























Grades 


"3W 


44% 


TO 


53% 


W 


2.9% * 


T 


.3 




13% 


"5B9" 


70% 


T3TT 


15% 


T? 


2% ; 


(n=840) 
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• . III. EVALUATION ABSTRACT 

PROGRAM : SPECIAL EDUCATION COMPONENT 

PROJECT .IDENTIFICATION NUMBER; .5001-62-01636 ' ' 

FUNDING PERTOD: September, 1980-June, 1981 

FUNDING SOURCE: U.S Department^ Education 
' ■* <? 

NUMBER OF STUDENTS IN PROGRAM: (FULL YEAR) 



STUDENT CHARACTERISTICS: 



NUMBER .OF SITES: 



SITE CHARACTERISTICS: 



MAJOR PROGRAM COMPONENTS: 



EVALUATION OBJECTIVE: 



EVALUATION INSTRUMENT: 



TYPE OF INSTRUMENT: 



TEST DATES: 
i . 

DATA ANALYSIS PROCEDURES: 



# pretested 

# posttested 



_94 
94 



94 special -education students from 
^ classes in Queens and St at en Island. 

Two. ; 

Queens special education classes with the 
classroom teachers were bused to the site 
in Queens one day a week; in Staten Island, 
the special education classes and teachers 
were at the site in their*home school or>e 
day a week. 

% Students participated in tw^readinq-oriented 
art workshops' and one readirrtj workshop each 
Friday. They took regular field trips and 
participated in the annual exhibition and 
performing arts festival. 

Sixty percfent of the students will master 
four instructional objectives at posttest 
which they had rvot mastered at pretest. 

Wisconsin Design Skill Development Test, 
forms P and Q, levels A, B, C, and D. 

Criterion-referenced test- 

Tests administered throughout* the year. 

* v 

Computation of percentage of students, 
mastering each instructional objective.. 



-9- ' 1 

16 



t 



SUMMARY OF RESULTS: 



OBJECTIVE MET: 



Ei qhty-ei cfFft percent >of the 'students passed 
at least four objectives, > 
Eiqhty-two' percent of the studertts passed at 
least-f-ive objectives, - * * 

Fifty-three percent of the Students passed at 
least <six obje'dtives. 

The objective was. surpassed. 



-10-' 
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. ' * IV. SPECIAL EDUCATION PROGRAM ' 

PROGRAM DESCRIPTION Ss \ ' ' ' ' ' 

The fjollowinq section df thVs.fepor^ presents trie evaluation data' 
for 94* special education students from the borouqhs of Oupfens and Staten 
Island who participated in the L.T.R.T.A, program.. The special education stu- 
dents in Queens and Staten Island participated in the program on Fridays for 29 
weeks. Entire classes, witti classroom teachers, were bused to the site in 

Queens.* In Staten Island, the program operated in the hotne school. 

/ / • . 

The special education program' foil owed basically .the samfe methodd- 
]ogy as the parent Tf'tle I, L.T.R.T.A. program. However; in the special^educa- 

* N 

tion program, .group sizes were smaller than in'the regular program and entire 
classes with their classroom teachers participated in the program. Allowances 
were made for the students 1 short ^attention span^with materials presented, f 
in a variety of ways. • Extra assistance was provided for students with special 
difficulties to enable them to participate in all program activities. 

The;students participated in a diaqnostic/prescripti^e reading work- . 
shop and two separate reading-jdriented arts workshops, which included paint- 



ing, sculpture, dnama, music, puppetry, printmaking, mixed media^ mime, and 
drawings The classroom teachers were .assigned to one of the readinq-oripnted 

arts' workshops to work with the artist teacher for' one part, of the.ctey and to 

/ ' ' • - ^ ' 

tJie reading workshop-for the other part of the day. t \ 

^Approximately 900 special education students participated in the program; 
however*, Vince the funding sources were ,di fferent, the other-student evalua- 
tions'are discussed in a separate report. ' See Tobias, R., Reichmanv-F. and - 
Francois, F. Title I/PSEN Reading and Math Services for the HandicaffieH, 
'chapter III, pg. 31-43, Office of Educational Evaluation, New York City Public 
Schools, 1980-81. . ; - . , 



The special education students participating^ the program went on 
regular field trips to the cultural institutions associated with the pYogram, 



as well as. to other museums, cultural institutions, uoi versities, and libraries. 

In addition, these students* exhibited their art work along side- that of the 

* ■ 
other Title I L.T.H.T.A. students in the annual Exhibition and Film Festival 

J s • • ■ • ° . 

xheld*at the-School of Visual Arts> . 

* • Th§ special education component followed the same model as the Title I 

L.T.R.T.A. with respect to teacher traj/i+nq'and parent workshops. 



EVALUATION RESULTS^- 



rThe program objective of the special ^education component was for 60 
"~ percent of the students to master at least four instructional- objectives at 
posttest which they had not mastered at pretest. 

The Wisconsin Design Skill Development Test, forms V and Q, levels . 
A, B, C and D, w^re used to assess mastery. The test is a criterion-referenced 
test oTreading skills which is administered to students throughout'the year on 
a pretest and posttest basis. Student? are prete£tec| during the beginning of 
the year to determine the areas and level of skills in which the'stud^Rt needs 
instruction. The reading teacher. determines when a student 'is ready to take , 
a posttest. The four skill areas emphasized in the program were comprehension, 
phonetic. analysis, structural analysis, and vocabulary. 

Special educationi_studer>ts far surpassed the criterion for proqr^m %. 
success. The objective v/as for 60 percent of the students to pass at least 
< fdur instructional objectives at posttest which they tftdn't pass- at pretest.' 

In fact, 88 percent of the students passed'four objectives', 82 percent of the 
% students pkssed at least five objectives, 53 percent, or one'half, passed six 

obje^ti ves^ aoxl, 35 percent of the students passed seven objectives. 

; , — — — -tt~ L J 
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' V:. COMMUNICATION B^H|EN.L.T.1*.T./V. STAFF AND CLASSROOM TEACHER 
COMMUNICATION t»J6CTIVES v * 



One of the lonq-standinq aims of educators related tp Title I pull-out ' O 
programs (that is, where. TiMe I., instruction occups'outside the child's class^ 
.room) is to integrate. Title I instruction with the classroom instructional pr^o- - 
gram. In order for integration and exchange of information to occur, cpmmuni- 
cation between staff members must take place. In 1980-1*981, one of the goals 
of the L.T.R.T.A* program was to promote communication between the program and 
from sending school classes. The goals of the increased communicatioos were 
the following: 

* . / • 

* * * f 

1: to inform sending school teachers of UT/R.T. A. activities 
and procedures; , a * 

% 1 

2. to promote continuity- of instruction and provide, opportuni- 
ties for teachers to reinforce the^ski 1 Is, tauqht i»n the 

program? and , ' 

* _ „ ' > 

3. to°enable program ahd class-room teachers to exchange re- ' 
levant information about pupil . behavior and academic 
progress. • . • 1 £ v 

7 In order -to achieve these goals, the following information was sent 
regular basis to the classroom teachers by l.T.R.T.A. coordinators: y ^ / 

-- lists of specialized vocabulary words found in nor'm-Vaferenced ; 
tests-, as used and diagnosed in the L.T.ffcT v A< program; 

-- L.T.R.T.A. lesson plans'; * * v > 

lists of suggested activities which would reirfforce J>he 
L.T>R.T.A. methodology; • * J 

diagnostic progress >rep<£rts of students 1 «reydirTq^nee,ds and _ 
achievement twice a year; . / 

-- readincj^oriented art workshop proqress reports twice a year; 

- - i and 

-- descriptions of field trips as they^ occurred. 
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In addition, classroom' teachers were ehcouraqed to sen* to L.T.R.T.A*. 

> • ^ t £ v * 

staff lists of vocabulary wb"nis used "1 n the Classroom. Efforts were also-made 
* — ♦ * 

by the L^T.R.T.A. coordinators to meet'the classroom' teachers and/or to esta- 
blish phone contact. " w * # 

ASSESSMENT PROCEDURES ' ; : 7 - ^ 
~ " , < • 

In order to assess the impact of these efforts, a sample of class- 

rooms fes visited at the beginning and end of the pYogram year. TWe criteria 

used toselect classrooms was that each classroom sent at least five students 

to the program. In'each case, the classroom teacher was sending students to 

the program for the fi^st-time/ A total of _11 classrooms in thVee schools were 

observed for 45 minutes each. Four special education ctasses.and seven regular 

classes were observed; classroom teachers were informally interviewed. A 

classroom observation form was designed to 'determine: 1) whether or not class- 

room instruction reflected the procedures anjd goals of the program; 2) wffether 

9r not' classroom displays and materials reflected the program procedures/and 

* • m . 

3) whether^ or .npt .there were any direct references to L.T.R'.T^A. on the part of 

the 'teachers- or. students(see Appendrx A). During the visits, any observable 

changes that hacj occurred during the course of the year were noted and the eva- 

luator dlscuss'ed with classroom teachers any contacts they may„h'ave had with 

UT.R.T.A. vstaff and/or program information. 1 

ft • • - - * ' 

ASSESSMENT RESULTS . • ' , ' . ■ • ; < . • 

* * * ' * ' * 

. •" At the end-of-the-year visit, teachers evidenced much greater* know- 

ledge'Of L.T.R.T.A. than they had during the fir^t visit. Teachers' described 

meeting with the program staff and receiving lesson plans and* other written 



EM.C \ 



materials. Several teachers said the materials wera well desiqned and commented 

•* % * 

that Ih^. program staf.f were consistently available for assistance. ^ 

* Evidence of carry-over to the sendinq school classroom was more ap- % 
parent i(i special education classes, where entire classes and teachers parti- 
cipate^ in L.T.R.T.A. One special education teacher had an L.T.-R.T.X. bulletin 
board displaying sculpture and painting vocabulary words. In anotfier cjassroom 

the children decided to make small cut-out self portraits' based on work they ' . 

♦ I ' . - " © ^ 

had done in L.T.R'.T.A. Another special education teacher commented*, that v there /, 

** • 

was natural carry-over into the ^lassroon^ evidenced by the Children 1 '^ increased * 

■ .» * . ' * " ' . " - 

likinq for music. * * * * 

■ * : 4 " * 

In the regular classrooms, the carry-over was not apparent. While 

• » * • • . 

^teachers had" received the materials sent and thought they were potei%t1aJ ly very 
useful, they said it was somewhat d'iff icul t *to carry over the program into-thejx ^ 
classroShisy The reason cited by several teachers was that only apportion of * 
the class wa§r participating and that referrinq to L.T.R.T.A. in their classroom 
might arrouse envy among the non-participants. Two teachers specifically stated 
that they would prefer toJiave the whole class participate. * v 

Two conclusions carf be drawn from the classroom observations and dfs- 

I » « ■ N.I' 

cussions with classrdom teachers. , *. 

iy Theproqram achieved its' goal with reqard to informinq sendinq 
school teachers abbut the L.T.R.T.A. activities and procedures, and promoted 
the exchanqe of Information related to pupil progress and behavior. The- 
L.L.R.T.X staff appear to have made themselves, available t6 classroom, teachers 
for teacher-initiated discussions and .arranged sessions in which L.T.R.T.A. * ' 

( : * 

staff could discuss program procedures} activities, and student progress. 



\ * 



2) GontinuHy of instruction between the* program and sending school 

;-v • - ^ : < 

classrooms appears to be .more feasible under the special education model; in i 
which an entire class, along with the classroom teacher, participates in the 
program, • Discussions with' teachers revealed that 4 special education teachers • 
were ab"te to proj^te su.ch carry-over both because they were participants in • 
the program and -because* it. was a shared experience for the entire class. 
Teachers in regular classrooms were hesitant to carry over^the program di- 
rectly into the classroonr because 1, ably a portion of their cla'ss participated, ■ 
Whether or not the materials and discussions s£nt by the program will .have a 
more far-reaching effe'ct on t+f§ these teachefs than could be observed in their 
classrooms-is a matte^ of conjecture, One of the teachers,, for .example, said 
he wou-ld consider the procedures and information he received in future curricu- 
1 urn planning. ^ * • 
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VI. IMPACT OF PROGRAM INVOLVEMENT IN THE NATIONAL . 
DIFFUSION NETWORK 



BACKGROUND 

' • f ■ H N 
Jn its role aS^rtieveloper/denionstratdr (D/D) site, the L.T.R.T.A. 

program recei ves^funding from the .National 'Diffusion Nejtwork* (N.D.N.) to pro- ' 

vide training materials and technical assistance to .schools and districts. Th§ 

' N.D..N. grant award has enabled the proqram to: develop traininq materials (cur-s 

riculum guides-, handbooks, lesson plaj)^); conduct awareness workshops designed 

to disseminate information about the proqram to' school districts .interested in 

adoption; and develop management procedures to monitor the implementation of 

'proqram adoptions. .Through N.D.N, involvement, the L.T.R.T.A. developer/demoh- 

- * • f 1 , 

straton has developed skills beyond its original strengths as an exemplary 

reading program. % • \ 

'This particular evaluation assessed tfie ways in which i) # N.D.N. fund- 

ing interfaces with Title IV-C and Ti*tle I funding to promote the development * 

of the program and I) involvement in N.D.N, has affected New York City Public- 



schools.. "The results may<t>e useful to other school districts and program de- 

" " - ' * / / f - 

velopers in showing how % N. D.N. funding allows the dp^ejopmejit-of expertise 

* i * a 

within the developer/demonstrator program and thereby. helps the school system 
itselif. v 

> * 

-The evaluators identified three areas of N % D.N. impaqt on the school 
system: 1) the materials," management procedures, and staff expertise can pro-, 
v;ide.New York City with a "turnkey" system for improving student readinq 
achievement; 2) the program's credibility as a nationally identified "exemplary 

» H - 

. ~ *The National Diffusion NetwacL-is a U.S.O.E. sijpported, nation 
system designed to he-Tg those involved in education acquire tfte materials and 
assistance they need id incorporate improved'.practlGeswinto thei/ programs. 

f "■ 1 -17 




program" encourages cooperative networking with other New YorKQv ty* orqantza- 
tions, and 3) the hujh standards and visibility of the D/D> t site improveTVaff 
morale wlpch in turn may affect student motivation. . ■ 

f MANAGEMENT, -MATERIALS, AND STAFF EXPERTISE ' / 

v. | v . 

Participation in N.D.N J has enabled L.T.R'.T.A. staff to gain expertise 

in all phases of program dissemination and management. LT.R'/T.A."staff have 

identified the vital steps needed „to operate a D/D^site and refiried these steps 

/ m 

i 

to prqvi-de effective service to adopters and -potential adopters. 

* N • As a D/D site, L.T.R.T.A. is responsible for ensuring that school 

districts adopting the program retain ,the essential characteristics of 

* « 

*^L.T.R.T*A. while successfully adapting these basic functions to meet the„indi\- ' 
vidual needs of the school districts involved. ^This coqiplex process is acconK ' 
pWsh'ejUhrough -a well -coordinated combination of personal contact and careful- 
ly designed materials. ^ # /% 

* / 9 * r^* . 1 ■ 

The first step4n the- process is to make school disr.icts aware of the, 
L.T.R.T.A. program; An "awareness" brochure and flyer .provide information about 
the. program's 'philosophy^ essential components, and "track record"; Districts 
, adopting the program are. provided with two days of intensive, pre-service train- 

* V - * • 

ing for participating staff. <The training'covers the prdqram^s unique diagnos- 
tic-prescriptive techniques and its integration of arts and reading-oriented 



r 

arts worksh 



•-'7 ■ * - ^ 



The D/Dirfoject dl rector .and' teacher trainers provide.on-going techrri-. 
cal assistance*. They hejp the* program construct an evaluation design, select 
field trips, and develop a* student exhibition. They provide feedback on curri- 
culum design and monitor the program to ensure that all. the^lssential components 

* 
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a^e implemented appropriately. ^The collection of'student achievement data by " \ 

' t, > 

the adopter site is also monitored by the~*D/D site. 'At the end of the imple- - 
mentation year v L.T.R.T.A.^provicles the adopter site with arv evaluation>eport 
of student achievement at the site, including when appropriate, recommendations 

I \ v 

for improving the student asessment' process.* • \ 

- . * -v.-. ' . \ ' ' ' . ^ 

L.T.R.T.A.-' s selection' ci§ one of the exemplary Teatiint} programs to be . 

used in the system's Promotional Gates Program* may /also be related to the pro- * 

gram's N.D.N, participation and exemplary program status^ National recognition 

# v . 

j 

of L.T.R.T.A. as a successful* reading program made L.T.R.T.A. a natural choice" 
for $he Promotional Gates Program. which will aim'at improvirytj-the reading skills 
of children w.ho have been retained in fourth and seventh grades due to. low * s 
achievement. j Because the L.T.R.T..A; program^has established an effective* sys- 
tem for dissemination of information, training personnel, and monitoring adop- 



tions of the, program, it is already equipped to help create effective replica- 
tions.^ * , 0*^ 

. , # . Another way in which-the New York City schools benefit from L.T.R.T/A. 
•involvement As through adoptions' df'the program: 12 public schools and 13 non-~ ^5 
ppb|.ic school's replicated L.T.R.T.A. over the past ttfcr years; These schools 



f 



have becoqje eligible for various types of funding, including replication grants, < 

.Title' IV-C mini-grants; and Title I and Title'lIT funding. In 1980-1981, adop- 

■ » 

* * * 

tions in New York City Poached over 50G students who have directty benefited 

from the L.T.R.T.A. program's Title IV-C and N.D.N, involvement. 



*The program is, a result of the policy which established^mihimum pro- 
motion standards for all students in grades kindergarten through nine. (See 
Chancellor's Regulations, June, 1980.) * „ « *• 



NETWORKING WITH NEW YORK CITY CULTURAL AND EDUCATIONAL INSTITUTIONS 

• ' 1 

* \ 

N.D.N, funding has, helped in establishing associations with many cul- 
tural institution, universities, and private corporations who-have formed 
associations with L.T.R.T^A. because it is an exemplary program. These associa- 
tions have resulted in program expansion and have ^benefited the school system \ 
t in general, as exemplified below. * 

During the 1979-1980 aad 1980-1981 ^school years, the program's annual * 
performi ng*arts festival was held^t Macy's department store (Macy's City-kids). 
This activity provided an entree for further association betwee'n the Board of 
Education and Macy's. /For example, through the Murjani Corporation, Macy's 
gave $3,500 in scholarships to ei^htL.T.R.T.A. students for summer da# camp. 
Macy's Corporation a]so supported the Chancellor's drive to improve school at- 
tendance in 1981. The exposure that the program gained through tj»sr? a ^fiatacts 



increases the< possibility of additio/tel associations in the futlire. 

N.D.N, recognition ha? also been instrument^ in facilitating networks 
with the city's universities. In January, and in the summer-o.f 1979, Fordham 
University offered a course i.n'Learrrlng to Read Through the Arts, th/ 1 course 
introduced the L^T.R.T.A. methodology to New York City teachers and^ther par- 
ticipating educators ^Ind helped to generate interest^ in program adoptions. * 
Other universities* (e.g. New York University, the School of Visual Arts, and 

City College of the City of New 'York) 'have sent'st^ent teachers to observe^the 

* x . > 

. program, as frart of field courses.* . 

* 

ASSESSMENT OF STAFF SKILLS' AND MORALE ■ 

Another approach to determining the impact of N.D.N, participation on 

- > ' i • 



a' school system is to assess/how teachers~are affected by-it. When teachers 

Is ■ 
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gain new skills or increase their motivation, the implementation of the program 
is strengthened. 

To evaluate the impact of N.D.N.- involvement on New York City school 
teachers implementing L.T.R.T.A., a questionnaire was developed which focused 
on the teachers 1 training, their contributions to traininq others and their 
performance and motivation. It was injtended to assess the role of the 
L.T.ft.T.A. instructionaXst^f with regard to N.D.N, involvement. (See sample 
questionnaire, Appendix B.). TKe questionnaire were distributed to L.T.R.T.A. 
staff at a meeting in April, 1981.^Fi fty-three of the S4 instructional staff 
members returned .completed questionnaires. Of these, 23 were special education 
staff members and 30 were regul an, staff members. Most of the staff thouqht that 
the dissemination materials, devel#ped^ith N.D«N. funding, were helpful to 
them in their own training in L.T.R.T.A. At least 73 percent of the respondents 
found the staff training manual, curriculum guide, and sample materials useful. 

Most of the respondents had contributed to one or more of the curricu- 
lum materials. All of the respondents who offered additional comments said con- 
tributing to the materials was meaningful in some way, including enhancing 
skills, clarifying ideas and qoals, gaining self-confidence, and practicing 
communication ideas. (See flsults section of Appendix. B.) 

Nearly all. of the respondents reported that outside visitors observed 
their workshops. These visitors ^ncluded New York City principals and district 
superintendents, as well as .evaluators and school personneT-f rom other school 
systems. Forty-three percent of the respondents had 15 or more visitors durinq 
the year. Reactions to the \4£itohs were genefally quite favorable, and 40 per- 
cent of the Vesftgndents reported that visitors gave them ^the incentive to plan 
more carefully. ^ <~ 
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Over half of the respondents said that -working in a. developer/demon- 



trator site hadla strong effect on their performance and 47 percent said it had 
.a strong effect on their morale. , • ^ 

CONCLUSIONS * 

— : ' * *- 

, 4 N.O.N, involvement j>&s provided the L.T.R.T.A. program with £ method 
for -developing materials ajid training procedures which benefits the, New York 
City school system. Through N.O.N, sponsored activities, L.f.R.T.flL has deve- 
loped program management skills, which are used with the Promotional §£tes Pro- 
gram, schools which adopt L.T.R.T.A. become eligible for federal funding, and 
' . 1 

associations ^with private and public institutions in New York City have been 
established; . * \ • , 

Information gathered from teacher questionnaire? indicates that N.D.N, 
funded mat^|33ls ar§ a valuable resource to teachers' implementing, the program. - 
Teaching at a developer/demonstrator site has affected 'teacher morale and <per- 
formatice, providing staff members wit v h motivation to plan curriculum more ; 
carefully. . . * gt ' • „ *' 



i 



* 
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VII. RECOMMENDATIONS 

« • The fpllowinq recommendations are based on the "assessments of student* 

achievement, site visits, interviews with program staff, and feedback about 

N.D.N, participation. v t 

1. Since L.T.R.T.A. ^has been so successful, it shduld be recycled and 

expanded to< serve more students. 

. c 

2 f . Due to its success wi^h special education students, the L.T.R^T.A. 
- . v ■ 

program shpuld continue to serve these students on a city-wide basis, with a 

site in each borotigh. • • . c 

3. Carry-over of program goals from the program to the sending 

v * " * * 

school classroom appears most feasible when entire classes, along with send- 

irrg schdol classroom Qachers, [participate. It is recommended therefore, that 

j f 

Entire classes: and classroom teachers participate in the program. 

M. ^Brooklyn has a-large waiting list of students e*11qibJle for the 
program. Because of the size of the borough and the number of eligible chil- * 
dren waiting to participate, it is recommended that ways be investigated to 
serve these children. 

5." As a developer/demonstrator site, L.T.R.T.A. staff have gained 
experience and expertise in all phases of program dissemination and management. 
.N.D.N, involvement has been found to have a positive impact on the program. 
Further evaluative efforts should focus on identifying characteristics of sue-" 
cessfuf prog/am adoptions. This type of evaluation may further tt?e city's 
efforts to *dis semi mate successful educational programs, as in the Promotional 
Gates Program. • • 
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Also, the school system should draw 4& the expertise of L.T.R.T.A. 



stiff as a valuable resource in efforts tU'iTnprove-reBxliTTtpskins, disseminate 
information, arid transfer successful practices. . m * 

6. L.T.R*T.A. has been very successful with special education pupils 
who can benefit from innovative and individualized instructional methodoloqies. 
8i 1 i nqual students also need the benefit of methodologies which are innovative 
and frequently not offeree! in the regular classroom. Therefore, it is sugqested 
that the L.T.R.T.A. administrators consider including bilingual pupils in the 
program. ■ r 

7. It is suggested that L.T.R.T.A. administrators p.resent their model 
of the ways, in which the program staff work in the schools to the nonpublic 
school administrators in order to determine the feasibility of L.T.R.T.A. in 
the nonpublic schools. (The L. T.R.J. A. Program could be supported with private, 
Title IV-C, and/or Title I'funds.) 

8. . The time and energy spent by the L.T.R.T.A. staff establishing and 
transferring sites in the beginning of^the year causes real concern which should 
be seriously addressed by administrators -in L.T.R.P.A. and the.Di vision* of Cur- 
riculum and Instruction. Solutions to this problem should be identified and 
considered for implementation (for example, securinq space for more than one 
year* maintaining neighborhQod schools which might otherwise be closed down 1>e- 

cause of under-utilization, or, wften fossible, identifying schools and settinq 

: ' • I V- 

up new, sites at the^nd of the scfiool yetoj. 

h *t + » } 
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APPENDIX A 

• >. " . - December/ 1980 

Learning to Read-Through the Arts * * 
' Classroom Observation form 

Observer: Date: ■ 




» 


- 

Time in: 

< - ; 






. . . Time out: 

» • 


• 


* 


\ * 

Borough: / , 

>. . • • 

School: v • 


* 




•Class! . . 
* Teacher's name: 




• 


#_Ch.ildren present/on register: v 

#. Children participating in program: 7 

• 

Time Period x ~ 
Lesson(s) Observed ' From: To: 

* * 

: ■ • ■ * * 

• X 


t 

% 


* 


• 

• • 


* 


* 


Remarks: • * . i 




* • 


• 

• . . .. - • 










£ " j if 

*\ * 

I? 


► * > ' ■ , • J ' • " " 

A ' - 
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Classroom Observation Torm, Page 2 

I. How does 'classroom instruction reflect the methodology and qoals of 
Learning to Read Through the Arts? 



A. Does the reading lesson observed integrate reacf(ng~with other subject 

areas? ' ' * 

ifYes "... 

No 4| * 

Comments: ' * , 



_ * 

B. , Does the lesson make use of any arts experience (music-, drawings, 
drama, etc.)? 
' Ye s 

No 

Comments: * « , 









\ 



C. If, yes,, are written materials (e.g., song sheets, p?ay directions, 
etc.) used as part of arts experience? - 

Yes . . * . 

N o. ). m ' 

•* . * 

Comments: . • . ' 4 • ' • 



0 >■ 



D. Are specialized vocabul ary words used in instruction? 
. Yes 



No 



Comments: 
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Classroom Observation Form, Page 3 

• » 

E. Are norm-referenced vocabulary words used in instruction? 

% Yes s : — " 

No • 1 



Comments: 



F. Are teacher-made materials used in instruction? v 

yes_ , / 

N o " . ■ • 

1 4 

Comments:" . . 







1 




- -* 




i 






* 




t 

• ■>' * 



' j 


\ 


m 


) 

/** 


-> * 
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' !— 













* 41.. Do classroom displays and materials reflect prbgrair'methodology?" 

A. Is .student art work or writing displayed in the classroom? 

. Yes ' = " 

No 




J 





B. Are there reading materials (e.g'. , books, magazines, posters, s-ign$) 

other than basal readers which reflect afts or other subject' area con-/"'" 
tents? ; V s > 

Ye s — ' - 

H o" 

Comments; , •* 



Classroom Observation ^rorm, Page 4 ♦ • ' ' 

_. 

C # Is there a place where students ,can record their own stories, activi- 
ties, ideas, etc. (e.q,, individual journals, experience chart) 4 ? 

Yes c : • 

No 1 

y 

Comments: * ^ 
If 1 1 ; — - 



5 



1 



D, Are norm-referenced v<ords on di sp*Tay? 

Ye s ' : 



Comments^ 

4 




v 



r ' 



E. Are specialized vocabulary words ori display? 

.N o ~ 
Comments: 



«8 


4 




/ 

m *** 




1 • 







F, Are teacher-made .materials on display in the classroom (worksheets, 
charts, etc,',)? T • # I 

Yes 

No " 



Comments: ' 



Classroom Obs'ervation Form, Page 5 ^ 
ILL .Miscellaneous ^ \ 



A, Discuss any other way? that classroom teachers are observed to use the 
Learning to Read Through the Arts curriculum or methodology. ] 



r r 



B. Discuss any^ ways that students in the program ate observed to use the 
Learning to Read Through the Arte^curriculum or methodology. 



C. Describe any direct referentes to Learning to Read Throucjh the-Arts 
(e.g., mention of field trj/p experience) on the part of teachers or stu- 
dents. 1 : 



NATIONAL DJFFUSXON NETWORK: 
N * . ■ ^ L.T.R.T. A. STAFF, QUESTIONNAIRE 



Date: t ' 

Staff position* (check one) 

Coordinator 

Workshop Liaiso n 
Artist Teacher 



APPENDIX B 



Reading Teacher 

Special Education! 7e5 No 



1; Which materials were helpful to'you when you repeiyed training in the 
LTRTA program methodology? Checkjihe ap^nc^Hate items. 

• * * 

Staff training manual i 

Curriculum, guide-reading lessons % , - 

^Sample materials (e.g. , master journals) 

* . SI ides "*» ^ . 

~0ther^ V 



2. . If you havp had inpu$ in the development of lesson plans and materials 
v used in training others, please indicate below wKat your specific in- 
volvement has .been. 

^Contribution to curriculum guide (e.g., lesson plans) . 
C ontribution to staff training handbook 

Contribution to dissemination materials (e.g., brochures, slides, - 

f video-tape) 

Materials, to be used for revised editions of above and new guides ^ 

Other . 

No specific involvement ^ * 

A. If this involvement has been meaningful to you as an educator pleas* 
indicate in what ways it has been meaningful. ^ 
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/ 3. Have you* had visitors!? from outside the proqram observe you in the class- 
room? 

Yei *. No 

A. If yes, fthich of the following personnel Have visited your classroom 
• .s/ite., Check off as many as apply. 

- -NYC teachers * , 

NYC school principals 

N YC district superintendents 
E valuators 

* School personnel frotm outside N.Y*.C. V 

Qtber ____ ; 

B. . Appro&mately how many visitors have you had during the course of the 

• * ■ 



1-3 



4-6 



7^10 



10-15 



15+ 



None 



' C. What was your react\o/i t^|having visitors at your site? 
Check . off as many statements ,as apply, u- „ > 

Gave me incentive to plan more carefully 

Enjoyed sharing experience with colleagues 

Increased my enthusiasm for the program 

H ad no significant impact 
Children enjoyed the experience 

Other * " < \ 



V 



4. Doyou-feel that'working in a Developer/Demonstrater s-ite#of the 
■National Diffusion Network affects your performance in any of the 
following ways? 

• A. Performance/Productivity (cir^^the apprppriate response): 
1. Little effect 2. Some effect 3. Strong effect 

• 4 

B. MoraTt* (circle the appropriate* responle) : 

1. Little effect" 2. Some effect 3. Strong ff feet 1 



f I 



\ - . • \ 
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If you have atiy additional comments to support your Responses to the ques- 
tions above, please indicate below: V * " 



Thank you for your cooperation. 



■ 1 



r 



\ 



\ 
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N.D.N. QUESTIONNAIRE RESULTS , ' . * 

♦ 

Described t>elow are the responses given by L.T,R.T\A, staff to each 
question on the N.D:N. Questionnaire, , The special education teachers' and 
regular teachers 1 questionnaire responses are' discussed together, since there 
did not appear to.be significant differences between responses of staff members 
working in 'the two f different areas. Fifty-three of the 84 instructional staff 
members returned completed 1 questionnaires.. 

0 ' * «► 1 

* * H „ 1 

I. 

Question 1: Which materials were helpful to you when you received training 
i rf the L.T.R.T.A program, methodology? (N=53) 



***** 



^Materials , : : Number : H> ' 

— ? — " — ^ — t ; ^ 

Staff training manual - 41 77% , 

Curcjdulum guide - reading lessons • 42 « 79% 

Sample, materials 39 11 73% 

14 . 26% 



Slides 




In addition-, some respondents wrote that orientation sessions, oral presenta- 



t4fcns, samples of children^ work and discussions with artist teachers. were 

'helpful. Seven respoydents-wrote that in-service meetings were helpful. 

The second que^ttBirasked staff, members to indicate their role in' 
* • ■» * 

the development of materials used to^train others: There were several write-in 

answers to this questtprv with, respondents iftcficating invo'lvemenj in staff 

/ * • * ' " ' . . ■ 

trairring, tape and slfde development, conducting N.D.N, workshops^, and demon- 

strations .fop visitors. 0 



Question 2 : If you have had input in the development of lesson plans and mate- 
rials used in training others, please indicate what your specific 
involvement has been, (N=53), 



Material Number* V 



Curriculum guides 24 45% 

— - t 

Staff training handbook 12 22% 

Dissemination materials 15 30% 
Revised editions of .forthcoming 

guides , 17- s 32% 

" ^Multiple responses reported, i 

When asked to describe how involvement in curriculum developm6nt and 

training wa%. meaningful to them: v 

— nine said it'enhanced their skills; 
*-six said it helped them clarify th^ir ideas'and goals; 
" * -^three-said it helped them gain self confidence; 'and 

--two said it gave' them' practice communicating. ■ /, 

Other respondents said contributions were meaningful because^of the ' 

"team involvement," because they had "pride in their work", because "it added 

to a resume", and because the program "provided an important art experience 

for children. " 

^ Question three asked if. the staff member had visitors from outside 

the program observe his/her workshops. As a Developer/Demonstrator site, one 
of the functions of the N.D.N, involvement is to provide visitors -with a mocjel 
of the program in actions Fifty- two oat of the 53 'respondents answering this 
question safid that, outside visitors had observed their site. Forty-six, or 
86, percent, of the respondents said that N.Y.C. teacher's had observed their 
classroom. Forty-two, or 79 percent, said N.^.C. principals had visited their 



classroom. Twenty-one, ^j/r 40 percent, said N.Y.C. district superintendents had 

visited ttfeir cJassroom. Thirty-six, or 68 percent, had been observed by eva- 

luators. Twenty-sltven, or 51 percent, had been observed by school personnel - 

outside of N.Y.C, from school superintendents to classroom teachers. Other 

V 

visitors included: special education supervisors, art therapists, artists, 



college supervisors, parents, eh^d education students. 

** 

The, next question, answered by 48 respondents, asked how many visitors 

had come to the workshops. The results indicated that: */ 

--three or 5% had one to three visitors; 
--nine or 19% had four > to six visitors; 
--six or 13% had seven to ten visitors; 
--seven or 15% had 11 to 15 visitors; and 
—23 or 48% had 15+. visitors. 

V ' < ' * 

Staff members were asked to indicate their reaction to having vi si - 

tors at the site. Fifty respondents answered the question. 

— Twentyrone (40%) indicated that having visitors gave them the incen- 
tive to plan more carefully. * . 

-Forty-three (81%) indicated that they enjoyed sharing experiences with 
* colleagues. ; ^ 

—Twenty-eight (53%) indicated tffat having visitors increased their 
enthusiasm for the program. / ~" 

--Six (11%) indicated that having visitors had no significant impact. 

--Twenty-seven (51%) indicated that, the children enjoyed th^ experience. 

t ^ ° : 

Other "responses included One comment that having visitors "kept 
everyone on their; toes;" another that they worked as'usual; and a third that 

"> -» ^, IT , 

rovided input and guidance for teaching." 

\ * v 

Question four asked if working at a developerXdemonstrator site af- : * 

t \ 

fected teaching performance. The responses were as follows: 
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—five (9%) said there was- little effect; 
—20 (38%). said. there was some effect; and ^ 
—28 (53%) said there was strong effect. * * 
* • 

Asked^if working at a developer/demonstrator site affected their 
morale; UT.R.T.A. staff answered af •follows: * - 

m 

—*ix (11%) said there was lit*Je effect; 
U —20 (38%) said there was -some Effect; * ~ 

* --25 (47%) said there was strong effect; and 
* - —two (4%) ga.ve no response. 



